%0 Conference Proceedings
%4 sid.inpe.br/sibgrapi/2020/09.30.16.45
%2 sid.inpe.br/sibgrapi/2020/09.30.16.45.08
%@doi 10.1109/SIBGRAPI51738.2020.00052
%T A Study on the Impact of Domain Randomization for Monocular Deep 6DoF Pose Estimation
%D 2020
%A Batista da Cunha, Kelvin,
%A dos Santos Brito, Caio José,
%A Valença da Rocha Martins Albuquerque, Lucas,
%A Magalhães Simões, Francisco Paulo,
%A Teichrieb, Veronica,
%@affiliation Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
%@affiliation Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
%@affiliation Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
%@affiliation Curso Técnico em Informática para Internet, Instituto Federal de Pernambuco, Campus Belo Jardim
%@affiliation Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco
%E Musse, Soraia Raupp,
%E Cesar Junior, Roberto Marcondes,
%E Pelechano, Nuria,
%E Wang, Zhangyang (Atlas),
%B Conference on Graphics, Patterns and Images, 33 (SIBGRAPI)
%C Porto de Galinhas (virtual)
%8 7-10 Nov. 2020
%I IEEE Computer Society
%J Los Alamitos
%S Proceedings
%K Pose Estimation, Deep Learning, Domain Randomization.
%X In this work, we apply domain randomization to synthetic images and train deep 6DoF monocular RGB pose estimation models to work on a real object. We compare 19 models trained with different combinations of synthetic and real data (fully synthetic, fully real, initially synthetic and supplemented with real, and a real-synthetic randomized mix). By gradually decreasing the amount of real data used, we show it is possible for deep 6DoF detection to obtain superior results while using less real data (which is harder to obtain) and suggest the best approach to train a model with synthetic data. Our method is validated using a textureless 3D printed object, as the textureless category is a challenging, common open problem in itself. A real and a synthetic dataset generated for this work, totalling over 24,800 annotated frames, are also made public. We also show that synthetic, randomized data can help generalize a model by training it to handle challenges such as illumination changes and fast motion. Finally, we also evaluate how a model trained for one camera sensor works with a different one, and show that synthetic simulations of real cameras can help overcoming this challenge.
%@language en
%3 108.pdf